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TITLE OF THE INVENTION 

PORTABLE APPARATUS AND REMOTE CONTROL SYSTEM 

CROSS-REFERENCE TO The RELATED APPLICATION 

This application is a continuation of International 
Application No. PCT/ JP00/02674 , whose International 
filing date is April 24, 2000, the disclosures of which 
Application are incorporated by reference herein. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a portable apparatus 
and a remote control system which can operate various types 
of electronic apparatuses. 

Description of Related Art 

Various types of electronic apparatuses such as a 
television set, a video apparatus, a stereo mini- 
component, an air conditioner, an illuminator and the like 
are widely used in domestic households, and these 
electronic apparatuses are operated in remote control to 
heighten their operability . 

However, management of the remote control unit is 
complicated by the face that a remote control unit is 
attached to each electronic apparatus. 

Also, in recent years, electronic apparatuses, which 
can be connected with an internet system, are widely used 
in domestic households. For example, in the case of a video 
apparatus capable of being connected with an internet 
system, even though a user stays outdoors, the programming 
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in the video-recorder to record a certain program can be 
set by using a portable telephone capable of being 
connected with the internet system. However, to set the 
video-recording of a program, the user is required to 
5 remotely operate the video apparatus according to a 
pre-determined procedure, and the pre-determined 
procedure is generally complicated. Therefore, even 
though the portable telephone has a function for setting 
the video-recording of a program externally, men and 

10 women of all ages have considerable difficulty in operating 
the portable telephone. 

The above-described remote control system is, for 
example, disclosed in the Published Unexamined Japanese 
Patent Application H9-102827 (1997). 

15 Because the conventional remote control system has the 

above-described configuration, the operability of each 
electronic apparatus can be heightened. However, because 
a remote control unit is attached to each electronic 
apparatus, there is a problem that it is complicated to 

20 manage the remote control unit and a cost of each electronic 
apparatus is heightened. 

Also, in cases where a portable telephone capable of 
being connected with an internet system is used, a user 
can set the video-recording of a program at the outdoors. 

25 However, because the user is required to perform a 

pre-determined complicated operation, there is another 
problem that men and women of all ages have considerable 
difficulty in operating the portable telephone. 



30 SUMMARY OF THE INVENTION 
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The present invention is provided to solve the above 
problems, and an object of the present invention is to 
provide a portable apparatus and a remote control system 
in which a plurality of apparatuses such as electronic 
5 apparatuses to be operated are easily operated in remote 
control without arranging a private remote control unit 
for each apparatus to be operated. 

In a portable apparatus according to the present 
invention, operation information input by an inputting 

10 means is transmitted to a central processing unit, the 
central processing unit refers to a data base in which a 
plurality of remote controller control instructions are 
stored, the central processing unit sends back the remote 
controller control instruction corresponding to the 

15 operation information, and an apparatus to be operated 
(hereinafter, called an operated apparatus) is controlled 
according to the remote controller control instruction. 

Therefore, the portable apparatus can easily operate a 
plurality of operated apparatuses in remote control 

20 without arranging a private remote control unit for each 
operated apparatus. 

In a portable apparatus according to the present 
invention, a voice emitted from a user is input as the 
operation information to the inputting means. 

25 Therefore, the user can operate each operated apparatus 
when the user expresses the contents of an operation by 
word/words . 

In a portable apparatus according to the present 
invention, a moving picture indicating a gesture of a user 
30 is input as the operation information to the inputting 



Therefore/ the user can operate each operated apparatus 
when the user expresses the contents of an operation by 
sign language or the shaking of user's body. 

In a portable apparatus according to the present 
invention, a letter or a symbol written by a user is input 
as the operation information to the inputting means. 

Therefore, the user can operate each operated apparatus 
when the user writes a letter or a symbol while using a 
tablet. 

In a portable apparatus according to the present 
invention, code information indicating letters or symbols 
is input as the operation information to the inputting 
means . 

Therefore, the user can operate each operated apparatus 
when the user inputs letters or symbols while using a 
keyboard. 

In a portable apparatus according to the present 
invention, an external power measured by an acceleration 
sensor is input as the operation information to the 
inputting means. 

Therefore, the user can operate each operated apparatus 
when the user takes a certain action. For example, the user- 
shakes the operated apparatus several times. 

In a portable apparatus according to the present 
invention, environment information measured by an 
environment sensor is input as the operation information 
to the inputting means . 

Therefore, the user can operate each operated apparatus 
without user's specific operation. 
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In a remote control system according to the present 
invention, operation information is transmitted from a 
portable apparatus, a central processing unit refers to 
a data base in which a plurality of remote controller 
5 control instructions are stored, the central processing 
unit sends back the remote controller control instruction 
corresponding to the operation information, and the 
portable apparatus controls an operated apparatus 
according to the remote controller control instruction. 

10 Therefore, the remote control system can easily operate 
a plurality of operated apparatuses by remote control 
without arranging a private remote control unit for each 
operated apparatus . 
In a remote control system according to the present 

15 invention, in cases where no remote controller control 
instruction coincident with the operation information 
exists, the central processing unit performs an ambiguous 
retrieval processing and sends back a remote controller 
control instruction most suitable for the operation 

20 information. 

Therefore, even though the user ambiguously expresses the 
contents of an operation, the user can appropriately 
operate each operated apparatus. 
In a remote control system according to the present 

25 invention, the central processing unit learns a 

correspondence relationship between the operation 
information and the remote controller control instruction 
most suitable for the operation information and sends back 
the remote controller control instruction without 

30 performing the ambiguous retrieval processing when the 



central processing unit receives the same operation 
information as that of the correspondence relationship 
next time. 

Therefore, even though no remote controller control 
5 instruction coincident with the operation information 
exists, the user can immediately operate each operated 
apparatus . 

In a remote control system according to the present 
invention, the central processing unit specifies a user 
10 of the portable apparatus in cases where the central 
processing unit has a data base of each of a plurality of 
users, the central processing unit refers to the data base 
of the user, and the central processing unit retrieves the 
remote controller control instruction corresponding to 
15 the operation information. 

Therefore, an operation suitable for the habits of each 
user can be performed. 

In a remote control system according to the present 
invention, the central processing unit charges a handling 
20 fee according to a use form of the remote controller control 
instruction used in the portable apparatus. 

Therefore, a charge for the use performed by the user, 
who is a subscriber of this system, can be rationally 
calculated . 

25 in a remote control system according to the present 
invention, the portable apparatus denotes a portable 
telephone . 

Therefore, a production cost of the portable apparatus 
can be reduced. 
30 in a remote control system according to the present 



7 



invention, the portable apparatus is fixed to the operated 
apparatus . 

Therefore, the portable apparatus can be used as an 
embedded apparatus. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a configuration diagram showing a remote 
control system according to a first embodiment of the 
present invention; 
10 Fig. 2 is a configuration diagram showing an internal 

configuration of a portable telephone of the remote control 
system according to the first embodiment of the present 
invention ; 

Fig. 3 is a configuration diagram showing an internal 
15 configuration of a portable telephone of the remote control, 
system according to a fourth embodiment of the present 
invention ; 

Fig. 4 is a configuration diagram showing an internal 
configuration of a portable telephone of the remote control. 
20 system according to a fifth embodiment of the present 
invention ; 

Fig. 5 is a configuration diagram showing an internal 
configuration of a portable telephone of the remote control 
system according to a sixth embodiment of the present 
25 invention; and 

Fig. 6 is a configuration diagram showing an internal 
configuration of a portable telephone of the remote control 
system according to a seventh embodiment of the present 
invention . 

30 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The invention will now be described with reference to 
the accompanying drawings . 
EMBODIMENT 1 

5 Fig. 1 is a configuration diagram showing a remote 

control system according to a first embodiment of the 
present invention. In Fig. 1, 1 indicates a portable 
telephone (or a portable apparatus) for transmitting 
operation information to a central processing unit 5 and 

10 controlling each of a plurality of apparatuses 

(hereinafter, called a plurality of operated apparatuses) , 
which are to be operated, according to a remote controller 
control instruction corresponding to the operation 
information when the central processing unit 5 refers to 

15 a data base 6, in which a plurality of remote controller 
control instructions are stored, and sends the remote 
controller control instruction corresponding to the 
operation information to the portable telephone 1. 2 
indicates a base station. 3 indicates a mobile 

20 communication network. 4 indicates an intranet. 5 

indicates the central processing unit, connected with the 
intranet 4 or an internet, for receiving the operation 
information from the portable telephone 1, referring to 
the data base 6 in which the remote controller control 

25 instructions are stored, retrieving the remote controller 
control instruction corresponding to the operation 
information from the data base 6 and sending the remote 
controller control instruction. 6 indicates the database 
for storing the remote controller control instructions. 

30 7 indicates a television set denoting one of the operated 
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apparatuses. 8 indicates a video apparatus denoting one 
of the operated apparatuses . 9 indicates an air conditioner 
denoting one of the operated apparatuses . Here, the present 
invention is not limited to the operated apparatuses 
5 composed of the television set 7, the video apparatus 8 
and the air conditioner 9, but it is applicable that a 
personal computer be included as one operated apparatus . 

Fig. 2 is a configuration diagram showing an internal 
configuration of the portable telephone 1. In Fig. 2, 11 

10 indicates a camera for photographing a moving picture 
indicating a gesture of a user. 12 indicates a microphone 
for receiving a voice of the user. 13 indicates a 
picture-voice analog-to-digital (A/D) processing unit for 
performing either a picture A/D processing for the moving 

15 picture photographed by the camera 11 or a voice A/D 

processing for the voice received in the microphone 12 and 
producing the operation information. Here, an inputting 
means is composed of the camera 11, the microphone 12 and 
the picture-voice A/D processing unit 13. 

20 14 indicates a transmitting unit {or a transmitting 

means) for transmitting the operation information 
produced in the picture-voice A/D processing unit 13 to 
the central processing unit 5. 15 indicates a receiving 
unit (or a receiving means) for receiving the remote 

25 controller control instruction when the central 

processing unit 5 refers to the data base 6, in which the 
remote controller control instructions are stored, and 
sends the remote controller control instruction 
corresponding to the operation information to the portable 

30 telephone 1 . 1 6 indicates a remote controller ( or a control 
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means) for controlling each operated apparatus according 
to the remote controller control instruction received in 
the receiving unit 15. A control signal is output from the 
remote controller 16 to each operated apparatus by using 
5 a wire means or a radio means (for example, blue-tooth, 
infrared ray ( IR) , ultrasonic wave, an HA bus , a local area, 
network (LAN) or UPnP). 

Next, an operation is described. 

A case where a user operates the air conditioner 9 
10 arranged in his house is described as an example. 

In cases where a room temperature is low and the user 
feels cold, when the user emits, for example, a voice 
"slightly cold", the voice "slightly cold" of the user is 
received in the microphone 11 of the portable telephone 
15 1. 

Thereafter, when the voice "slightly cold" is received 
in the microphone 11, a voice signal indicating the voice 
is output as operation information from the picture-voice 
A/D processing unit 13 to the transmitting unit 14, and 
20 the operation information is output from the transmitting 
unit 14 to the central processing unit 5 through the base 
station 2. 

When the operation information is received in the 
central processing unit 5 from the portable telephone 1, 

25 the central processing unit 5 refers to the data base 6 
in which a plurality of remote controller control 
instructions are stored, and a remote controller control 
instruction corresponding to the operation information is 
retrieved in the central processing unit 5 from the data 

30 base 6. 
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Here, a plurality of remote controller control 
instructions corresponding to various types of operated 
apparatuses (the television set 7, the video apparatus 8 
and the air conditioner 9) are stored in the data base 6, 
5 and there are a plurality of remote controller control 
instructions corresponding to the air conditioner 9, and 
the remote controller control instructions corresponding 
to the air conditioner 9 are indicated as follows as an 
example. In this case, it is applicable that the operation 
10 information be expressed by the Japanese language or a 
foreign language. Also, it is applicable that the operation 
information be expressed by combined words of the Japanese 
language and a foreign language. Also, it is applicable 
that the operation information be expressed by words which 
15 include an ambiguous expression of a deaf-and-dumb person. 
Operation Information Remote Controller Control 

Instruction 

slightly cold -> rise in temperature by 1 °C 

very cold -> rise in temperature by 2 °C 

20 slightly hot -> fall in temperature by 1 °C 

very hot -> fall in temperature by 2 °C 

In this example, because the user emits the voice 
"slightly cold", "rise in temperature by 1 °C " is detected 
as the remote controller control instruction 
25 corresponding to the operation information. 

Thereafter, the remote controller control instruction 
denoting "rise in temperature by 1 °C " is sent back from 
the central processing unit 5 to the air conditioner 9 
through the portable telephone 1. 
30 In this example, the remote controller control 
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instruction coincident with the operation information 
exists. However, in cases where no remote controller 
control instruction coincident with the operation 
information exists, an ambiguous retrieval processing is 
5 performed, and a remote controller control instruction 
most suitable for the operation information is sent back. 

For example, in cases where the user emits a voice 
"extremely cold", no remote controller control 
instruction coincident with the operation information 

10 exists. However, in cases where the meaning of the phrase 
"extremely cold" is considered, the operation information 
"very cold" is most similar to the phrase "extremely cold" 
among the four pieces of operation information relating 
to the air conditioner 9. Therefore, a remote controller 

15 control instruction corresponding to the operation 

information "very cold" is retrieved. That is, "rise in 
temperature by 2 °C " is retrieved and sent back. 

Also, when a remote controller control instruction most 
suitable for the operation information is retrieved in the 

20 ambiguous retrieval processing performed in the central 
processing unit 5, a correspondence relationship between 
the operation information and the remote controller 
control instruction most suitable for the operation 
information is learned. Thereafter, in cases where the same 

25 operation information as that corresponding to the remote 
controller control instruction in the learned 
correspondence relationship is received next time, the 
remote controller control instruction is sent back without 
performing the ambiguous retrieval processing. Therefore, 

30 when the user emits a voice "extremely cold", the remote; 
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controller control instruction "rise in temperature by 
2 °C " is immediately retrieved and sent back without the 
performance of the ambiguous retrieval processing. 

Here, in cases where a similarity between a voice, for 
5 example, "channel 4" emitted by the user and each piece 
of operation information relating to the air conditioner 
9 is very low, the central processing unit 5 retrieves no 
remote controller control instruction relating to the air 
conditioner 9. However, in cases where the voice "channel 

10 4" coincides with a piece of operation information relating 
to the television set 7 or in cases where the similarity 
between the voice "channel 4" and a piece of operation 
information relating to the television set 7 is high, there 
is a case where the central processing unit 5 retrieves 

15 the remote controller control instruction relating to the 
television set 7. 

Thereafter, when the remote controller control 
instruction is sent back by the central processing unit 
5, the remote controller control instruction is received 

20 in the receiving unit 15 of the portable telephone 1 and 
is output to the remote controller 16. 

When the remote controller control instruction 
transmitted from the receiving unit 15 is received in the 
remote controller 16 of the portable telephone 1, the air 

25 conditioner 9 denoting one operated apparatus is 

controlled according to the remote controller control 
instruction. In this example, an operation, in which the 
central processing unit 5 instructs the air conditioner 
9 to perform a rise in temperature by 1 °C , is performed. 

30 As is described above, in the first embodiment, 
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operation information is transmitted from the portable 
telephone 1, the central processing unit 5 refers to the 
data base 6 in which a plurality of remote controller 
control instructions are stored, a remote controller 
5 control instruction corresponding to the operation 

information is sent back to the portable telephone 1, and 
the portable telephone 1 controls an operated apparatus 
according to the remote controller control instruction. 
Therefore, each operated apparatus can be easily operated 

10 in remote control without arranging a private remote 
controller for each operated apparatus. 

Also, a plurality of learning results, each of which 
indicates a correspondence relationship between operation 
information and a remote controller control instruction 

15 most suitable for the operation information, are 

accumulated in the data base 6, the data base 6 itself can 
be used as an information source. Therefore, the database 
6 can be independently set as a commodity to be sold. 

20 EMBODIMENT 2 

In the first embodiment, a control signal is transmitted 
one-sidedly from the remote controller 16 to each operated 
apparatus, and the operated apparatus is operated. However, 
it is applicable that a response signal transmitted from 

25 an operated apparatus be received in the remote controller 
16, the response signal be inserted into operation 
information and be sent to the central processing unit 5, 
and a remote controller control instruction be sent back 
to the portable telephone 1 while considering the response 

30 signal in the central processing unit 5. 
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EMBODIMENT 3 

In the first embodiment, a voice emitted by the user 
is transmitted as operation information to the central 
5 processing unit 5. However, it is applicable that a moving 
picture indicating a gesture of the user be transmitted 
as operation information to the central processing unit 
5. In this case, the same effect as that in the first 
embodiment can be obtained. 

10 In detail, when a moving picture indicating a gesture 

of the user is photographed by the camera 11 of the portable 
telephone 1, a picture processing for the moving picture 
photographed by the camera 11 is performed in the 
picture-voice A/D processing unit 13, and the moving 

15 picture is transmitted to the central processing unit 5 
through the transmitting unit 14. 

When operation information (that is, the moving 
picture) transmitted from the portable telephone 1 is 
received in the central processing unit 5, the central 

20 processing unit 5 refers to the data base 6 in which a 
plurality of remote controller control instructions are 
stored, and a remote controller control instruction 
corresponding to the operation information (that is, the 
moving picture) is retrieved. 

25 in the third embodiment, because a plurality of moving 

pictures (for example, a gesture indicating "slightly 
cold" ) indicating operations of each operated apparatus 
are stored in the data base 6, the moving picture 
transmitted from the portable telephone 1 is collated with 

30 each of the moving pictures stored in the data base 6, and 
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a remote controller control instruction coincident with 
the operation information or a remote controller control 
instruction most suitable for the operation information 
is retrieved and sent back to the portable telephone 1. 
5 Therefore, each operated apparatus can be operated by 

expressing contents of an operation by sign language 
operated or the shaking of a user's body. 

EMBODIMENT 4 

10 in the first embodiment, a voice emitted by the user 

is received as operation information. However, as shown 
in Fig. 3, in cases where a tablet 17 is connected with 
the portable telephone 1 , it is applicable that a user input 
letters/characters written by the user to the picture- 

15 voice A/D processing unit 13 as operation information while 
using the tablet 17 and the operation information be 
transmitted to the central processing unit 5. 

Therefore, the user can operate each operated apparatus 
by writing letters /characters or symbols while using the 

20 tablet 17. 

EMBODIMENT 5 

In the first embodiment, a voice emitted by the user 
is received as operation information. However, as shown 

25 in Fig. 4, in cases where a keyboard 18 is connected with 
the portable telephone 1 , it is applicable that a user input 
code information of letters /characters or symbols as 
operation information while using the keyboard 18 and the 
operation information be transmitted to the central 

30 processing unit 5. 
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Also, it is applicable that a user input code 
information of letters /characters or symbols as operation 
information while using a ten-key 19 (including dial keys) 
of the portable telephone 1 and the operation information 
5 be transmitted to the central processing unit 5. 

Therefore, the user can operate each operated apparatus 
by inputting letters /characters or symbols while using the 
keyboard 18 or the ten-key 19. 

10 EMBODIMENT 6 

In the first embodiment, a voice emitted by the user 
is received as operation information. However, as shown 
in Fig. 5, it is applicable that an acceleration sensor 
20 be arranged in the portable telephone 1 so as to output 

15 operation information, which indicates a repeated 

detection of an acceleration (or an external power) higher 
than a certain strength, in cases where the acceleration 
is repeatedly detected prescribed times. 

Therefore, in cases where the portable telephone is 

20 shaken three times, an operation, in which the television 
set 7 is, for example, switched on, can be performed. 

EMBODIMENT 7 

In the sixth embodiment, the acceleration sensor 20 is 
25 arranged in the portable telephone 1. However, as shown 
in Fig. 6, it is applicable that an environment sensor 21 
be arranged in the portable telephone 1 so as to measure 
environment information (for example, temperature, 
humidity, luminous intensity, CO density and/or smoke). 
30 Therefore, because the environment information can be 
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transmitted to the central processing unit 5 as operation 
information, the air conditioner 9 or the like can be 
controlled according to the environment information. 
Accordingly, the air conditioner 9 or the like can be 
5 controlled without user's specific operation. 

EMBODIMENT 8 

In the first embodiment, the central processing unit 
5 refers to the data base 6, and a remote controller control 

10 instruction corresponding to operation information is 
sent back. However, in cases where the data base 6 is 
divided into a plurality of data bases respectively 
corresponding to one user, it is applicable that an 
authentication processing be performed in the central 

15 processing unit 5 according to a voice of a user to specify 
the user. 

Therefore, the central processing unit 5 can refer to 
the data base of each user, and a remote controller control 
instruction corresponding to operation information can be 

20 retrieved in the central processing unit 5 for each user. 
Accordingly, an operation adapted to the habits of each 
user can be performed. 

For example, in cases where a user is oversensitive to 
cold and prefers a warm room, a rise in temperature by 1 °C 

25 normally adopted is not adopted, but an operation of a rise 
in temperature by 2 °C can be performed. 

EMBODIMENT 9 

In the first embodiment, a charge for the use performed 
30 by the user, who is a subscriber of this system, is not 
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described. However, it is applicable that the central 
processing unit 5 charge a user a handling fee according 
to a use form (for example, a type of an operated apparatus, 
a use time and the like) of a remote controller control 
5 instruction used by the portable telephone 1. 

Therefore, a charge for the use performed by the user, 
who is a subscriber of this system, can be rationally 
calculated . 

Also, in cases where an operated apparatus is, for 
10 example, an electronic apparatus (for example, a 

television set, a refrigerator, or an air conditioner) 
leased, it is applicable that the central processing unit 
5 charge a user for a handling fee of an operated apparatus 
according to operation information transmitted from the 
15 portable telephone 1 . 

Also, in cases where pieces of operation information 
transmitted from the portable telephone 1 are collected 
in the central processing unit 5, statistics of demand for 
each operated apparatus and data of audience rating for 
20 each television program can be obtained, and the statistics 
of demand and the audience rating data can be used as basic 
data for an electric power demand plan or the editing of 
television programs. 

25 EMBODIMENT 10 

It is applicable that a portable apparatus be fixed to 
an operated apparatus. This idea is not described in the 
first embodiment. 

Therefore, the portable apparatus can be used as an 
30 embedded apparatus. 



20 



As is described above, in cases where various types of 
electronic apparatuses are operated, the portable 
apparatus and the remote control system according to the 
present invention are appropriate to a plurality of 
5 electronic apparatuses which are operated in remote 

control without arranging a remote control unit for each 
electronic apparatus. 



